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A Pupilometer 

Field of the Invention 

This invention relates to an apparatus commonly known as a pupilometer. 
Background of the Invention 

In the neurological assessment of an unconscious patient, pupil response is known to be 
a vital aspect of the diagnostic process. Regular assessment of the size, reactivity to light 
and equality of pupils is essential for early recognition of neurological deterioration in 
situations where intra-cianial pathology is a threat. As such this assessment is regularly 
carried out in paramedic, intensive and high dependency care situations. 

The current method of practice is to manually measure these aspects using a bright light, 
which stimulates reactivity of the pupil, and make a note of the dilation compared to the 
original size of the pupiL Actual measurements taken are then compared with a card 
having different pupil sizes marked thereon. This method of assessment is time 
consuming, and subjective. 

Pupilometers have been developed for use in the assessment of eye shape and condition, 
monitoring tiredness, and in the detection of drugs or alcohol in a person. 

A hand-held pupilometer is described in US 6,022,109 pal Sante). This pupilometer 
detects and measures pupil diameter and pupil response to a light stimulus. Also 
described is software to permit the diagnosis of alcohol or drug presence. However, use 
of this pupilometer requires the active participation of the user. 
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Another hand-held pupilometer is described in US 6,199,985 (Anderson). This patent 
describes a method for measuring optical power output from the pupiL However, the 
pupilometer described in the patent requires complex optometric components. 

Another hand-held pupilometer is described in US 6,260,968 (Starl^. The device 
described includes an LCD display via which prompts to the operator are given. The 
pupilometer described in this patent uses a "flying spot" algorithm to establish a 
circumference fitting the pupil, and the pupil radius. The pupilometer includes software 
to aid diagnosis. Again, the pupilometer described in this patent requires complex 
optometric components. 

It would therefore be desirable to provide an improved pupilometer. 
Summary of the Invention 

According to one aspect of the invention there is provided a pupilometer as specified in 
Oaiml. 

According to another aspect of the invention, there is provided image processing 
software as specified in Claim 34. 

The software may be embodied on a record medium, stored in a computer memory, 
embodied in read only memory, or carried on an electrical signal 

According to another aspect of the invention, there is provided a process for obtaining 
pupil image information as specified in Claim 35. 

According to another aspect of the invention, there is provided a hand-held pupilometer 
as specified in Claim 36. 
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Brief Description of the Drawings 

In the drawings, which illustrate exemplary embodiments of pupilometers according to 
the invention: 

Figure 1 is a schematic representation of a perfect eye; 
Figure 2 is a block diagram of a pupilometer, 
Figure 3 is a schematic representation of an eyeball; 
Figure 4 is an image of an eye under ambient light; 
Figure 5 is an image of an eye under infra-red light; 

Figure 6 shows a raw image taken by the pupilometer before any image processing has 
taken place; 

Figure 7 shows the image of Figure 6 after the identification of dark pixels; 
Figure 8 is a table used to identify an edge; 

Figure 9 shows the image of Figure 7 after identification of the pupil edge; 

Figure 10 shows the image of Figure 9 at the beginning of a spiral search; 

Figure 11 shows the image of Figure 9 with adjoining pupil edge pixels connected to one 
another, 

Figure 12 is a table illustrating a recursive flood-fill algorithm; 

Figure 13 shows the image of Figure 1 1 with the rectangular dimension of the pupil 
identified; 
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Figure 14shows an image of apart of an eye dose to the pupfl when subjected to 
highlights from infra-red LED's of the pupflometer; 

Figure 15 shows the image of Figure 14 with possible highlights marked; 

! 

Figure 16 shows the comparison of highlight vertical co-ordinates in Figure 15; 

Figure 17 shows identification of the highlights of Figure 16 with the closest vertical 
alignment; 

Figure 18 shows the image of Figure 17 with the distance between the two valid 
highlights matted; 

Figure 19 is a graph showing the reaction over time of a pupil diameter to a light 
stimulation; 

Figure 20 is a schematic cross-section of a hand-held pupflometer, 

Figure 21 is a plan view of the pupflometer illustrated in Figure 20; 

Figure 22 is a block diagram of the pupflometer shown in Figures 20 and 21; 

Figure 23 is a schematic representation of a pupflometer of the invention in close 
proximity to an eye; and 

Figure 24 shows an image of a part of an eye close to the pupil when subjected to 
highlights from infra-red LED's of the pupflometer, 

Figure 25 shows the image of Figure 14 with the highlights marked; 

Figure 26 is a schematic representation of the marked highlights of Figure 15; 



WO 2004/058056 PCT/GB2003/005653 

5 

Figure 27 shorn the image of Figure 14 -with the distance from the highlight to the centre 
marked; and 

Figure 28 shows the image of Figure 14 with the distance between the two highlights 
madked 

Detailed Description of the Preferred Embodiments 

Figure 2 illustrates the components of an embodiment of the pupilometer. The 
pupilometer comprises a camera board 10 including a camera, which in the example is a 
CMOS (Complementary Metal Oxide Semiconductor) camera 11, a filter 12, which in the 
example is an infra-red pass filter, a pair of infra-red light emitting diodes (ER LED's) 13, 
and a light emitting diode (LED) 14 for emitting white light. The camera 11 and LED's 
13, 14 are mounted on a board, which in the example is a printed circuit board 15, the 
filter 12 being mounted in front of the lens of the camera 11: 

The camera board 10 is connected by suitable cabling to a control board 20, which 
mounts an analogue interface 21, a micro-controller 22, a memory 23 and a Universal 
Serial Bus (USB) interface 24. The analogue interface 21, memory 23 and USB interface 
24 axe each connected to the micro-controller 22 by suitable cabling 25. The analogue 
interface 21 receives an analogue video signal from the camera board 10 and converts 
said signal into a digital form- The micro-controller 22 provides control signals for image 
acquisition from the camera board 10, and transmission of image data to a computer 
programmed with custom pupil detection and measurement software, which in the 
example is a laptop computer 26 connected to the micro-controller 22 via a USB 
interface 24. However, the computer programmed with custom pupil detection and 
measurement software could easily form part of a hand held pupilometer device. Such a 
device is described with reference to Figures 20 to 22. 
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The control board 20 also mounts a memory module 23 which provides additional static 
RAM for storage of image data acquired from the camera board 10 prior to transmission 
of the image data to the computer 26, with the USB interface 24 providing a physical 
interface for the conversion and transmission of image frames to the computer 26 over a 
standard USB interface. 

The computer 26 of the example runs the operating system, "Microsoft Windows 95", 
and custom software which detects and measures the pupil in the images generated by 
the camera. 

Referring now to Figure 3, the IR LED's 13 shine light towards the eyeball 30, but to the 
sides of the pupil 31. By virtue of iUuminating the eyeball by shining light to the sides of 
the pupil 31, most of the rays of light entering the pupil are internally reflected and 
absorbed by the retina, and thus the camera only sees light reflected from the surface of 
the eye, with the pupil appearing as a dark area. 

The purpose of the infra-red pass filter 12 is to stop all visible light entering the camera 
11, which eliminates the effects of ambient light conditions, thereby permitting accurate 
control of the instrument. 

Figures 4 and 5 illustrate the difference in appearance of an eye under ambient light 
conditions (see Figure 4) and infra red lights (see Figure 5). In Figure 5, the contrast 
between the pupil 3 and the iris 2 is increased compared to Figure 4. Also, there is much 
less surrounding detail in Figure 5 compared to Figure 4. 

The reflections from the IR LED's 13 can be seen clearly in Figure 5, and the distance 
between these specular highlights is used as measure of the distance from the camera to 
the eye (the closer the IR LED's are to the eye, the further apart are the highlights). 



WO 2004/058056 PCT/GB2003/005653 

7 

Referring now to Figure 23, the eye lis illuminated by light in the infra-red spectrum of 
light beams 32 emitted by the infra-red LED's 13. The camera 11 sees highlights 33 on 
the surface of eyeball 30. For the pupilometer to generate an output of pupil size, 
separate highlights from each infra-red LED 13 must be detectable, and therefore must 
be within a certain distance of the surface of the eyeball The extremes of the light 
beams 32 are illustrated by dotted lines. Qeariy, if the infra-red LED's are too far away 
from the surface of the eyeball, they will overlap, in which case two spaced apart 
highlights 33 would not be appear on the surface of the eyeball. Conversely, if the infra- 
red UED's are too close to the surface of the eyeball, then the highlights will be so far 
apart as to be located in close proximity to the eyelids, rather than in the central region of 
the surface of the eyeball 30. In such a situation, the two highlights cannot be detected. 
Hierefore, if the pupilometer is outside the range where r^ is the minimum 

distance from the infra-red LED's to the surface of the eyeball 30, and r^ is the 
mayirrmm distance of the infra-red LED's to the surface of the eyeball 30, two separate 
highlights cannot be detected, and the pupilometer software produces a range error 
signal. The algorithm restarts the ranging step after pupil detection in the next captured 
image. 

Referring now to Figures 20 to 22, there is shown a hand-held pupilometer, which 
comprises a camera board 110 including a camera, which in the example is a CMOS 
(Complementary Metal Oxide Semiconductor) camera 111, a filter 112, which in the 
example is an infra-red pass filter, a pair of infra-red light emitting diodes (ER LED's) 
113, and a light emitting diode (LED) 114 for emitting white light The camera 111 and 
LED's 113, 114 are mounted on a board, which in the example is a printed circuit board 
115, the filter 112 being mounted in front of the lens of the camera 111. 
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The camera boaxd 110 is connected to a control board 120, which mounts an analogue 
interface 121, a micro-controller 122, a memory 123 and a computer interface 106. The 
analogue interface 121, memory 123 and computer interface 106 are each connected to 
the micro-controller 122 by suitable cabling 125. The analogue interface 121 receives an 
analogue video signal from the camera board 110 and converts said signal into a digital 
form. The micro-controller 122 provides control signals for image acquisition from the 
camera board 110. Further, the micro-controller 122 transmits image data to, and runs, 
custom pupil detection and measurement software. 

As mentioned above, the control board 120 also mounts a memory module 123 which 
provides additional static RAM for storage of image data acquired from the camera 
board 110 for use by the custom pupil detection and measurement software of the 
micro-controller. 

The computer interface 106 provides a physical interface for transmission of data to an 
external computer. It may be desirable to store test results in patients' notes, or for 
research purposes, and whilst the hand-held device 100 has sufficient memory to record 
a number of results, to use the device continually, the memory 123 must be cleared from 
time to time. 

As with the device described with reference to Figure 3, the IR LED's 1 13 shine light 
towards the eyeball 30, but to the sides of the pupil 31. By virtue of illuminating the 
eyeball by shining light to the sides of the pupil 3 1, most of the rays of light entering the 
pupil are internally reflected and absorbed by the retina, and thus the camera only sees 
light reflected from the surface of the eye, with the pupil appearing as a dark area. 



WO 2004/058056 PCT/GB2003/005653 

9 

Piipilnme ter Software 

The main function of the software is to interpret the image of the eye and detect, or 
classify, the pupil within that image. The software was developed using Borland Delphi 
and in the example executes under the Microsoft Windows operating system. 

The basic requirement is the ability to detect a circle (i.e. the pupil) within the image and 
known algorithms available for the performance of this task include the Hough 
transform, parametric matching and neural network classification. However, these 
methods are computationally intensive and require a floating-point numeric processor in 
order to achieve optimal performance. 

One aim of the invention to provide a standalone hand-held pupilometer. This means 
that a relatively low specification microprocessor must be used and therefore the 
algorithm of the invention is a simple multi-stage classification algorithm, which uses 
integer mathematical functions to classify the pupil within the image. 

Referring now to Figure 1, there is shown a model of a perfect eye, Le. the iris 2 is at the 
centre of the eyeball 1 , with the pupil 3 being at the centre of the iris 2. Further, both the 
pupil 3 and the iris 2 are perfect circles, the boundary 4 between the iris 2 and the pupil 3 
is sharp, and the darkest region of the eye is the pupil 3. 

The software of the invention makes certain assumptions based on the model of the 
perfect eye described above, those assumptions being: 

1) The pupil will be the darkest area of the image; 

2) The pupil - iris boundary will have the sharpest edge; 

3) The pupil - iris boundary will be elliptical. 
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The software provides three principal functions; 

1 . Pupil classification: the detection and measurement of the pupil within the image 
of the eye. 

2. Rangng the detection and measurement of the ER LED reflections on the eye 
surface allowing calculation of distance from camera to eye. 

3 . StimJatiaz measurement of the pupil reflex action to light stimulation. 
Pupil Classification 

The classification algorithm of the invention provides for the differentiation of the 
pupil from other dark areas of the image, such as shadows, and from interference 
within the pupil boundary, for example eyelashes and highlights. 

The control board 20 transmits a new image every 200ms via the USB interface 24. 
The image is returned as a two-dimensional (128 x 128 pixel) array of 6 bit values, 
with each value representing the grayscale intensity of the relevant image pixel in the 
range 0 to 63. This image is then subjected to the following processing steps: 

1 ) As the raw image array is read into the Delphi program, the values of the 
darkest (Vdark) and the lightest (Vlight) pixels are calculated and stored 
Threshold levels are then calculated using these values; Tdark=Vdark+4 and 
Tlight=Vlight-2 - see Figure 6. 

2) All image pixels with values of less than or equal to this dark threshold (Td) are 
assigned to the PUPIL class - see Figure 7. 

3) The edge values across each of these PUPIL class pixels are calculated using 
the simple gradient algorithm | P4-P0 1 +|P4-P1| +|P4-P2| +|P4-P5| +|P4- 
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P8|+|P4-P7|+|P4-P6|+|P4-P3|=G the grass radial gradient This 
algorithm produces the gross radial gradient (G) across the central pixel (P4) - 
see Figure 8. 

4) All image pixels with edge values (G) of greater than or equal to 8 are assigned 
to the PUPILEDGE class - see Figure 9. The pupil edge value of 8 was 
selected using empirical methods as a value discriminating valid edge pixels. 

5) In order to locate an area of PUPILEDGE pixels large enough to be the 
actual pupil, a spiral search is initiated from the centre of the image (or the 
centre of a valid pupil from the previous frame to improve the speed of 
location), is used to locate the first PUPIL_EDGE pixel and this is assumed to 
lie on the pupil boundary- see Figure 10. 

6) When the search locates a PUPILEDGE pixel - see Figure 10, All adjoining 
PUPIL EDGE pixels are connected using a recursive flood fill algorithm 
The fill algorithm also tracks the numbers and extents of the adjoining pixels, 
from which the width and height of pupil region are derived - see Figure 1 1. If 
the fill connects more than 16 pixels, the area is designated as being the pupil 
boundary area and die algorithm continues to step 7. If the fill connects less 
than 16 pixels, the area is designated as being too small to be the pupil and the 
spiral search (5) continues outwards until another PUPIL EDGE region is 
found or the extents of the image are reached. If the pupil boundary area has 
not been located by the end of the spiral search, the algorithm restarts at step 1 
with the next captured image. 
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In steps 5 and 6, every time the spiral search hits a PUPILJEDGE the region is 
flood filled to try to find a region large enough to be the pupil. When the pupil is 
identified, the spiral search exits. 

Recursive flood fill 

The fill algorithm sets the target pixel and tests each of its four neighbours, in north- 
west-south-east order, for another PUPIL EDGE pixel As soon as such a pixel is 
found, the algorithm re-calls itself with this new pixel as its target. An enlarged view 
of a typical fill pattern is shown in Figure 12. The first branch is filled by the routine 
calling itself nine times and stops when no further PUPIL EDGE pixels are found, 
the second branch (dotted arrows) search then starts. In this way, the routine 
continues until all adjoining PUPIL EDGE pixels have been set - see Figure 12. 

The rectangular dimension of the pupil boundary area is calculated from the extents of 
the flood fill and an ellipse consisting of thirty-two points is fitted inside this rectangle. 
If twelve or more of these points hit a PUPIL EDGE pixel the region is classified as 
the PUPIL and the range detection phase begins; if not the search re-starts with the 
next captured image. The pupil diameter is defined as the maximum diameter of the 
ellipse - see Figure 13. 

Rangng 

When a valid pupil has been classified it is known that the highlights from the infra red 
LED's will appear in the image within close proximity to the pupiL Therefore to 
improve speed of calculation and removal of artefacts from eyelids etc, only the area 
around the pupil is searched. 
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A first procedure for ranging is illustrated in Figures 14 to 18, and is described below. 
The search identifies discrete groups of pixels which could belong to valid highlights 

With reference to Figure 14, a search area 84 wide by 64 pixels high centred around the 
pupil is scanned to identify pixels with values of greater than or equal to the previously 
assigned threshold Tlight, these are classed as HIGHLIGHT TE ST pixels. When 
such a pixel is found, a flood fill of adjoining HIGHLIGHTJTEST pixels is initiated 
during which the number of pixels and centre co-ordinates of the fill area is recorded 

Possible highlights are defined as fill areas with pixel counts within the range 4 to 256 
pixels, and figure 15 illustrates the identification of such areas. These areas are 
designated as possible valid highlights and their centre co-ordinates and pixel counts are 
stored in an array. In order to minimise memory usage, a maximum of 16 areas are 
allowed 

As shown in Figure 16, when the whole search area has been scanned and two or more 
possible highlight areas identified, the vertical positions of all areas are compared in order 
to identify the two areas with the closest vertical alignment 

Figure 17 shows the identification of two such areas. 

If less than two or no suitably aligned highlights have been identified, the algorithm is 
unable to derive range information, and a "range error" signal is generated and the pupil 
detection phase restarts on the next captured image. 

Figure 18 illustrates the final range step, where with both valid highlight areas identified, 
the horizontal distance between their centres and the geometry of the infra-red LED 
position and the light emitted thereby allow the software to calculate accurately the 
distance of the pupilometer from the surface of the patients eyeball. If the distance to 
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the eyeball is outside the valid detection range to r^, the algorithm will generate a 
"range error* signal and the pupil detection phase restarts on the next captured image. 

A second procedure for ranging is illustrated in Figures 24 to 28 is described below. 

With reference to Figure 24, an area twelve pixels above and below the pupil is scanned 
to find the BRIGHTEST p\x&\ leveL 

With reference to Figure 25, the area is rescanned and pixels with a value greater than 
BRTGHTESTSaie marked as HIGHLIGHT 'pixels. The maximum x/y extent of 
these HIGHLIGHT pixels is recorded and the centre of the extents is calculated. 

Centre X = (Max Highlight X-Min Highlight X) / 2 

Centre Y = (Max Highlight Y - Min Highlight Y) / 2 

Figure 26 illustrates horizontal lines of pixels, starting from the centre pixel (PASS 1) and 
expanding one pixel vertically above and below the centre line (PASS 2... ), which are 
scanned to the right hand extents until a HIGHLIGHT pixel is found. 

Figure 27 shows the HIGHLIGHT area flood-filled, with the centre of the area 
calculated from the extents of the flood-fill. Steps 16 and 17 are then repeated for the 
pixels on the left-hand side of the centre pixeL 

Figure 28 illustrates the next step, where with both highlight areas identified, the 
horizontal distance between their centres is used as a measure of the range. 

Stimulation 

A lookup table is used to calculate the absolute pupil diameter in millimetres from the 
measures of pupil pixel diameter and range. "When a valid pupil measurement has been 
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made, the system can start a stimulation cycle to obtain the pupil constriction response 
curve after stimulus by a bright white light source. The LED 14 generates -white light In 
a stimulation cycle the LED 14 is energised In this example, the period during which 
the LED 14 is energised for approximately 600 ms. 

During the stimulation cycle, the pupil diameter is continuously measured and recorded 
using the above described algorithm whilst the white LED is energised. A graph, 
illustrated in Figure 19, of the pupil diameter is then drawn, a typical response curve is 
shown below. 



Where the following measurements can be taken; 



L Latency (ms) Time between start of stimulus and beginning of 

contraction 

A Contraction amplitude Difference between the mean post-stimulus 

(mm) diameter and minimum per-stimulus diameter 

Tc Contraction time (ms) lime from end of latency to minimum pupil 

diameter 



In the case of a hand-held pupilometer as described with reference to Figures 20 to 22, 
the graph may be displayed on the display 102 of the hand-held device, or on a VDU. 

The response curve can be used in itself in diagnosis, or the response curve can form 
part of an expert system, which may generate a diagnosis. 

The invention allows for the calculation of the distance between the surface of the 
eyeball and the camera. No spacer of fixed dimension is required to establish a pre- 
determined distance between the camera and the surface of the eyeball. 

Furthermore, there is no requirement for a patient being examined to keep its head still, 
and look in a fixed direction. The pupil of the patient being examined need not be 
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aligned with the centre of the camera. The pupilometer of the invention functions as 
long as the infra-red LED's produce highlights in the vicinity of the pupiL As well as 
permitting examination of semi-conscious or unconscious patients, the pupilometer can 
be used on patients who cannot necessarily follow instructions, for example children, 
impaired individuals, animals, etc. Rather than assuming that the pupil is a dark area in 
the centre of the image, the pupil finds the dark pupil anywhere in the image. 

The invention provides a simple and relatively low cost device for use in a variety of 
operational situations. Further, it provides a reliable and objective means of assessing 
pupil response. 



